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(57) Abstract: An electronic file, e.g., an MP3 
file, is partitioned into a sequence of segments 
at the server side. The first segment is played 
out (108) upon downloading (106). While the 
first segment is being played out, the second is 
being downloaded and buffered (110) so that it 
is available when the play out of the first segment 
is completed. While playing out a current one 
of the segments, next one(s) of the segments are 
being downloaded and bufifered. This partitioning 
and sequential play out enables to emulate 
streaming of a file and to minimize latency while 
downloading an electronic file. 
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Partitioning of file for emulating streaming. 



FIELD OF THE INVENTION 

The invention relates to content and/or control communications between 
multiple computer systems, or to such communications between computer systems and 
consumer devices. Specifically, the invention relates to communication constrained by 
5 bandwidth or limited by data processing resources available to the receiving system or 
device, especially if the communications are received by the user in real time. The type of 
communications can be, e.g., broadcast, multi-cast or point-to-point. 

BACKGROUND ART 

1 0 Consider current major technologies for delivering digital content, such as 

audio, video, etc. The streaming method for audio, e.g., RealAudio by RealNetworks, 
consists of playing-out audio at a client device, while constantly sending data from the server 
to the client. The technology provided by RealNetworks comprises an encoder, a server, a 
splitter/cache and a player system with two-way intelligence to resolve network congestion, 

1 5 lost packet conditions and negotiate complex internet protocols. More specifically, the known 
technology comprises an automatic, variable bit-rate encoding and delivery system for audio 
and video. The system scales to megabit connection rates and dynamically adjusts the 
transmission rate as delivery rate varies due to network congestion. The format and the 
encoding/decoding methods of the data are proprietary. The server and the client synchronize 

20 receiving and playing in a way pre-defined by the particular architecture. The communication 
stack software is tightly coupled to the interpretation layer (application and user interface 
(UI)). Manufacturers of such technology promote high level of integration between client and 
ser\'er software, as a complete vertical solution. This approach mostly excludes third parties 
from developing custom server software (e.g., advenizing, services) and/or client 

25 applications (UI, special effects, etc.). 

Another known method is downloading of a content file from a remote 
computer with subsequent play-out on the client. MP3 is a widely known audio data format 
used within the downloading context. There are other data formats, e.g., MP4 for video data 
etc. The major advantage of the above mentioned method is its open data standard approach. 
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As long as the right format of the content file is observed during encoding, client and server 
software/hardware manufacrurers are free to develop their own solutions/products. 

A major problem with the complete download approach is the inherent 
latency: there is a delay between the beginning of the download and the sian of the play-out. 
5 The larger the file and/or smaller the communication bandwidth, the longer it takes to 

transfer the content from the server to the client. This is particularly undesirable in consumer 
electronics systems, where perceived delay is detrimental to market acceptance of an open 
architecture. 

1 0 SUMMARY OF THE INVENTION 

It is an object of the invention to provide an open architecture solution for 
content delivery in a download approach that allows for a low or negligible play-out latency. 
To this end the content file is split into multiple parts. Each part or segment requires a 
relatively short download time. Therefore, the play-out latency is determined by the 

15 download time of the first part. The size of the individual part can be determined by the 
communications bandwidth, e.g., through pinging for a latency-check. The client 
device/application receives control information about the content. This control information 
comprises, for example, information relating to the size and memory location of the whole 
file as well as of it's parts at the ser\'er. If the client is not capable of processing split data, it 

20 proceeds with the traditional approach, i.e., downloads the whole file and then plays it out. In 
case the client is capable of processing parts of the content, it uses the relevant control 
information about the parts in order to continue downloading data, while playing. Data play- 
out, also called '"rendering", is computation-intensive, since it requires a plurality of decoding 
operations. Data download is baiidwidth-intensive. Accordingly, simultaneous play-out and 

25 downloading do not significantly compete for the same system resources. This separation 
between downloading and processing can be efficiently used in a multi-process and/or multi- 
thread environment. 

Preferably, the information contains references to the file location as well as 
references to the locations of the pans. The intended bandwidth information is associated 

30 with the parts. The client may make its own decisions regarding how many parts to download 
before the start of the play out (execution). 

The parts can have different data formats. The format of some of the parts can 
be proprietary. Information about alternative content parts, regarding bandwidth, format, 
location access options, etc., can be provided. Content parts can physically reside on different 
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servers. Content can be split into pans consistent within the semantics of the content, for 
example, the end of musical plirase, paragraph, target control device, etc. A third party may 
insert its own content parts in between the original content parts. The third part\' parts 
contain, for example, advertisements, commentary, customization options. The format of 
5 parts for play-out may be chosen according to user-related information, for example, personal 
preferences, level of access to premium services, quality of the equipment, bandwidth 
sharing/fluctuation conditions, etc. 

BRIEF DESCRIPTION OF THE DRAWINGS 
1 0 The invention is explained in further detail and by way of example with 

reference to the accompanying dravmigs wherein: 

Fig. 1 is a flow diagram illustrating the various steps in a method according to 
the invention; and 

Fig.2 gives an example of control code. 
15 Throughout the Figures, same reference labels indicate similar or 

corresponding features. 



PREFERRED EMBODIMENTS 

The invention enables emulating the streaming of files while using a download 
20 approach. Fig.l illustrates a flow diagram 100 with various steps involved in the playing-out 
of a segmented file at the client. 

In step 102, the client contacts the server, selects the particular content file and 
dovmloads the control information that enables the retrieving and playing out of the 
segmented file. The control information describes the locations, (URL's), and size of the 
25 various file segments, and provides, for example, UI fiinctionalities at die client. In this 
example, the control information is coded in Extensible Markup Language (XML). 

In step 104 the XML code is parsed. Parsing of XML is well known in the art, 
A person skilled in the art can download an XML interpreter, including source code, firom the 
Internet, see for example the URL www.ibm.com/xml. Thus, the client is enabled to get 
30 information about the content information and the URLs of the first and subsequent file 
segments. 

In step 106, the first file segment is downloaded for play-out. Communicating 
v^th a remote server is a well known technology. For example, Java 2.0 provides a set of 
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Standard classes that enable retrieving a remote file into a buffer or as a stream, (see, e.g., 
ww\\'.sun.com - java 2.0 java.io.* package documentation). 

In step 108, the rendering of the first segment is started. The buffered content 
of the first segment is forwarded to a decoding/playing module. The decoding/playing 
5 module decodes the file format which may be, for example, MPSTThe playing of the supplied 
stream of bits involves a number of standard operating system calls to its drivers-a technique 
well known in the art. 

In step 1 10, the next file segment is downloaded at the client and stored in a 
buffer while the previous file segment, here the first file segment, is being played out. One 

1 0 option is to have the downloaded files buffered in a sequence or linked list of buffers. This 
functionality is typically provided by the operating system of the client. For example, the 
'Microsoft Windows family of products creates a memor\^ buffer associated with the file 
every time an Application Program Interface (API) call opens the file. Alternatively, in a 
thread- and/or process-rich environment, several threads and/or processes can be organized to 

15 independently retrieve file segments, while playing out the content of other segments. 

Working with threads is a skill common for software engineers. For example, Java 2.0 from 
Sun Microsystems provides classes supporting multiple threads (see, for example, 
java.lang.thread and related documentation). Similarly, Microsoft Software Development Kit 
(SDK) for the Windows family of products makes thread- or process-related functionalities 

20 available to programmers. 

Upon completion of playing out the first segment, the second segment is 
passed on from the buffer to the decoding/playing module. This can be implemented by 
means of, for example, a linked list. As known, a linked list is a data structure wherein each 
element (here: segment) has content data and a pointer to a next element (here: next 

25 segment). 

The decoding/playing module has to decode the file format. The decoding 
program represents a standard task to a person skilled in the art to program a decoding 
procedure according to a widely published standard ( for example MP3, etc.). The playing of 
the supplied stream of bits involves a number of standard operating system calls to its drivers 
30 - a technique well known in the art. 

Fig.2 gives an example of information-describing content coded in XML. The 
code fragment labels the segments as having a title "The best ever music" performed by 
"V.R. Famous" and having several parts. The segment labeled "parti" is in a preferred format 
and described the length of the part, for example, in bytes, the format, the minimum 
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bandwidth required for a connection, and the location on the Internet. An alternative first part 
is labeled "parti alt" having a different length, vdifferent format, different minimum 
bandwidth requirement and a different location. The XML code can be combined with 
Extensible Style Language (XSL) for generating a user level UI at the user's client. The 
5 client thus can automatically choose the format compatible with the client's play-out 
capabilities. 

When the client has selected the proper file, either the one of which the first 
part is represented here as in the preferred format or the one m the alternative format, the 
content of the first part is downloaded from the location specified and playing out is started 

1 0 automatically under application control. Combining multiple sequenced inputs is well 
understood in the industry. For example, Java Development Kit (JDK) v. 1.2 from Sun 
Microsystems, Inc. provides a class java.io.SequenceInputStream (see 
hTtp://iava.sun.com/products/idk/1.2/docs/api/iava/io/SequenceInputStreams.html ) as a 
standard component of the io class librar>'. SequencelnputStream represents the logical 

1 5 concatenation of other input streams. It stans out with an ordered collection of input streams 
and reads from the first one until end of file is reached, whereupon it reads from the second 
one, and so on, until end of file is reached on the last of the contained input streams. An 
object of the java.io. SequencelnputStream class can be initialized by, e.g., enumeration (see 
http://iava.sun.eom/products/idk/l.2/docs/api/iava/util/Enumeration.htmn of objects of the 

20 InputStream class (see 

hnp://iava.sun.com/products/idk/1.2/docs/api/iava/io/InputStream.himn . This abstract class 
is the superclass of all classes representing an input stream of bytes, including the class 
FilelnputStream (see http://iava.sun.eom/products/idk/l.2/docs/api/iava/io FilelnputStream) . 
In case of the downloading of riiultiple file parts, an application can create instances of the 

25 FilelnputStream class from local temporar\' files into which the pans are being downloaded. 
The contents of those multiple local files will be supplied to the Sequencer. The rendering 
component of the application v^U read the information out of it as if it were just a single local 
file. 

The segmentation of the content file into separately downloadable segments 
30 enables a third party, such as a service provider, to insert between two segments specific 
content information, e.g., advertisements to be rendered on the client's display. 

During operation, the client application could select a next segment in a 
different format for the same content to adapt to changing circumstances, e.g., lower 
bandwidth due to network congestion. Also, the user could be prompted to subscribe to a 
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service that as a demo lets the user download only the first segment in a high quality and the 
next segments in a lower quality. The combination of XML and a corresponding parser and 
interpreter at the client controls the downloading and playing out as explained above. 
Accordingly, the client pulls the content segments from the locations indicated in the XML : 
5 control information for buffering and subsequent play-out. 

The implementation of a client in this client-server architecture can be done in 
a variety of ways. A first example is a hardware-based single-purpose device, similar to the 
Rio MP3 player by the Diamond Corp. In order to accommodate the method of the invention, 
the player needs, in addition, an XML parser, the ability to interpret XML and the ability to 
10 download and play-out content segments sequentially. A second example is to implement the 
method of the invention as a software application on a multi-purpose computing device, e.g., 
a PC or a set top box. The device has the software implementing the functionalities 
mentioned above. In a graphics-rich environment, multiple GUI's are represented to the user 
for further customization. 
15 The following co-pending applications are incorporated herein by reference: 

U.S. serial no. (Attorney docket PHA 23,768) filed 9/27/99 for 

Raoul Mallart for SCALABLE SYSTEM FOR VIDEO-ON-DEMAND. This patent 
document relates to a Video-on-Demand service (VOD) that is emulated in a Near-Video-on- 
Demand (NVOD) architecture. Content information is made available to an end-user in the 
20 NVOD architecture. An inu-oductory portion of the content information is stored at the end- 
user's equipment, e.g., by downloading overnight. During playing out of the introductor\' 
portion at the end-user enabling the content information supplied in the NVOD architecture is 
buffered at the end-user's equipment. The equipment is controlled to switch from playing out 
the introductor>- portion stored to playing out the buffered content information. 
25 U.S. serial no. 09/189,534 (Attorney docket PHA 23,528) filed 1 1/10/98 for 

Eugene Shteyn for CONTENT SUPPLIED AS SOFTWARE OBJECTS FOR COPYRIGHT 
PROTECTION. This document relates to supplying content information such as a movie, an 
audio file or a textual message to an end-user in a software object. The object has an 
encapsulated procedure for end-user access of the content information in a runtime 
30 environment. The object can specify time frame for and maimer wherein the content 

information is to be.accessed. Since the procedure is encapsulated in the object together with 
the content data, and since transport of the object over the Internet is done after serializing, an 
adequate degree of security is provided against unauthorized play-out or copying. 
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U.S. serial no.09/149,950 (Attorney docket PHA 23,495) filed 9/9/98 for ^ 
Raoul Mallart for REAL TIME VIDEO GAME USES EMULATION OF STREAMING 
OVER THE INTERNET IN A BROADCAST EVENT. This patent document relates to 
emulating streaming of animation data over the Internet to a large number of clients in a 
5 broadcast application on a client-server network. The animation is considered a sequence of 
states. State information is sent to the clients instead of the graphics data itself. The clients 
generate the animation data itself under control of the state information. The server and 
clients communicate using a shared object protocol. Thus, streaming is accomplished as well 
as a broadcast without running into severe network bandwidth problems. This approach is 

1 0 used to map a real life event, e.g., a motor race, onto a virtual environment in order to let the 
user participate in a virtual race against the real life professionals, the dynamics of the virtual 
environment being determined by the state changes sent to the user. 

U.S. serial no. 09/1 38,782 (Attorney docket PHA 23,491) filed 8/24/98 for 
Raoul Mallart and Atul Sinha for EMULATION OF STRE.AJVlING OVER THE INTERNET 

15 IN A BROADCAST APPLICATION. In a broadcast application on a client-server network 
the streaming is emulated of animation data over the Intemet to a large number of clients. 
The animation is considered a sequence of states. State information is sent to the clients 
instead of the graphics data itself. The clients generate the animation data itself under control 
of the state information. The server and clients communicate using a shared object protocol. 

20 Thus, streaming is accomplished as well as a broadcast v^thout running into severe network 
bandwidth problems. 

U.S. serial no. 09/283,545 (attorney docket PHA 23,633) filed 4/1/99 for 
Eugene Shteyn for TIME- AND LOCATION-DRIVEN PERSONALIZED TV. This 
document relates to a service for personalized video recorders such as the one from TiVo- 

25 Philips. The recorder has a hard-disk that serves as a random-access buffer. 

From reading the present disclosure, the other modifications will be apparent 
to persons skilled in the art. Such modifications may involve other features which are already 
known in the design, manufacture and use of systems and devices and component parts 
thereof and which may be used instead of or in addition to features already described herein. 
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CLAIMS: 



1 • A method of enabling to emulate streaming of a file over a data network to a 

.client, the method comprising: 

partitioning the file into multiple segments; 

enabling the client to download (106) a first one of the segments for playing 

out- 
enabling the client to download (1 10) a next one of the segments while playing 

out a current one of the segments; 

enabling the client to buffer the next segment while playing out the current 

segment; and 

enabling the client to start playing but the buffered next segment upon 
completion of the playing out of the current segment. 

2- The method of claim 1, wherein the partitioning is detemiined by information 

about the client. 

3. The method of claim 1 or 2. wherein the partitioning is determined by 

information about the network. 

4- The method of claim L2 or3, wherein the file comprises an audio file. 

5- The method of claim 1,2 or 3, wherein the file comprises a video file. 

6- The method of anyone or more of claims 1 to 5, wherein the partitioning 
comprises adding respective tags to respective ones of the segments. 



7. An electronic file comprising information content partitioned into multiple 

segments that are separately downloadable over a data network, the file comprising control 
information for enabling to play out a first one of the segments upon downloading, enabling 
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to buffer a second one of the segments while the first segment is being played out and 
enabling a seamless transition between the playing out of the first and the second segments. 

8. The file of claim 7, wherein a respective one of the multiple segments 
5 comprises respective control information. 

9. The file of claim 7 or 8, implemented as a linked list. 

10. The file of claim 7, 8 or 9, comprising the control information in Extensible 
1 0 \farkup Language (XML) format. 

11. A device for play-out of infomiation content received' over a data network 
from a server, wherein: 

- the information content comprises multiple segments; 

15 -'the device is capable of downloading a first one of the segments fi-om the server for playing 
out; 

- the device is capable of downloading a next one of the segments while playing out a current 
one of the segments; 

- the device is capable of buffering the next segment while playing out the current segment; 
20 and ..-.^ 

- the device is capable of staning to play out the buffered next segment upon completion of 
the playing out of the current segment. 

12. The device of claim 11, wherein: 

25 - the content information is accessible through control information provided to the device; 
and 

- the de\ ice is capable of interpreting the control information to retrieve the segments from 
the sen*er for sequential play-out. 

30 13. The device of claim 12, wherein: 

- the control information comprises an XML format; 

- the device has an XML parser; and 

- the device has an XML interpreter. 



<XMb 
<title> 

The best ever music 
</title> 
<artist> 
V.R. Famous 
<yartist> 

<parts> (Prefeffed form^) 

<part1> 

<length> 1024 </lenglli> 
<format> MP3 </formab 
<location> flp://1 37.27.52.87 </location> 
<min_bandwidlh> 10,000 </min_ban(lwi(jtti> 
</part1> 



</part1jlt> 

<length>512</lengtti> 

<fonrat> OTHER </lonTiat> 

<localion> hllpy/ yevgeniynet/ .... .</localion> 

<min_bandwidth> 8,000 <:/min_bandwidlti> 
</partjlt1> 
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2/2 



(Allemtivelornat) 



</parts> 



</XMb 
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